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ABSTRACT 

We construct a simple, regularized estimator for the dark energy equation of state 
by using the recently introduced linear response approximation. We show that even a 
simple regularization substantially improves the performance of the free form fitting 
approach. The use of linear response approximation allows an analytic construction of 
maximum likelihood estimator, in a convenient and easy to use matrix form. We show 
that in principle, such regularized free form fitting can give us an unbiased estimate 
of the functional form of the equation of state of dark energy. We show the efficacy of 
this approach on a simulated SNAP class data, but it is easy to generalize this method 
to include other cosmological tests. We provide a possible explanation for the sweet 
spots seen in other reconstruction methods. 

Key words: cosmology:theory - methods: statistical -cosmological parameters. 



1 INTRODUCTION 



One of the most exciting discovery of the last decade is the 
possibility that the expansion of our Universe is accelerat- 
ing (Perlmutter et al. 1999; Riess et al. 1998). The simplest 
explanation in terms of a cosmological constant runs into to 
a fine tuning problem (Sahni & Starobinski 2000; Peebles & 
Ratra, 2002; Padmanabhan, 2002). Therefore, it has become 
popular to phenomenologically model the component that 
drives the acceleration as an ideal fluid with an equation of 
state given by P = wp, where the equation of state parame- 
ter w is allowed to vary with time. In this parameterization 
the cosmological constant model corresponds to w = —1. 
In the recent years there has been a considerable interest in 
devising methods to extract information about the equation 
of state from the present and the future cosmological data. 

In principle, since this information is coded directly into 
the distance (luminosity and angular) measures, it is possi- 
ble to directly obtain 'w{z) from the supernovae distances 
(Starobinsky, 1998). This requires the knowledge of up to a 
third derivative of noisy estimate of the distance measures 
with respect to the redshift. This makes such direct esti- 
mation extremely noisy. Methods based on flexible fitting 
functions (Saini et al. 2000; Nakamura & Chiba 2001) for 
the luminosity distance have been invoked to get around 
this problem. In such schemes the number of parameters 
in the fitting function is kept small, therefore, the allowed 
behaviour of the equation of state is restricted by the adop- 
tion of specific forms for the fitting functions. Other pop- 
ular methods approximate the dark energy density or the 
unknown function 'w{z) as low order polynomials (Sahni et 
al. 2002; Weller & Albrecht, 2002). Since the quantity of 



interest is the equation of state, direct expansion of 'w{z) 
are better able to constrain the dark energy. Saini et al. 
(2003) (hereafter SPB) show that the distance measures are 
approximately linear functionals of the equation of state in 
the possible range of parameters. Using this they calculate 
the expectation value of the polynomial approximations for 
any given 'w{z). They conclude that schemes based on poly- 
nomial expansion of the equation of state are useful since 
they measure certain well defined, integrated properties of 
the underlying, true equation of state. 

Wang & Lovelace (2001) show that by considering the 
dark energy density in redshift bins the bias inherent in the 
finite parameterization of the dark energy can be easily re- 
moved. Huterer & Starkman (2002) apply a similar method 
to binned equation of state parameter, w{z). A limitation 
of this approach is that due to the large number of bins 
required to reconstruct the precise behaviour of the dark 
energy, the estimated equation of state turns out to be very 
noisy. Huterer & Starkman (2002) find that although a di- 
rect reconstruction looks hopelessly noisy, useful information 
about the equation of state is still coded into the Fisher 
matrix. They show that by diagonalizing it, a few princi- 
ple components could still be measured with good accuracy 
from the future experiments. They advocate the use of eigen 
vectors of the Fisher matrix as the optimal basis to express 
the unknown function 'w{z). 

Such free form reconstructions of the equation of state 
do not return a smooth function. Our main aim in this pa- 
per is to show that simple regularization of the free form 
estimation helps substantially in bringing down the noise in 
the reconstruction. In SPB the linear response approxima- 
tion was used to formulate a similar free form reconstruc- 
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Figure 1. A free form reconstruction of w{z) = — 1 + 0.2 ln(l + z) 
without added noise. The thick sohd line shows the input model, 
the wiggly line is the reconstruction without any regularization 
and the solid line shows reconstruction with regularization. Small 
departures form the true equation of state are due to numerical 
noise and inexactness of the linear response approximation. 



tion in a matrix form. We use this approximation in this 
paper to investigate the effect of introducing smoothness as 
a constraint. Although the accuracy of the linear response 
approximation is limited, we make use of it in this paper 
since it enables the regularization to be done analytically. 
Similar results hold for the exact case. We also show that 
an iterative scheme could in principle extend the applicabil- 
ity of the linear response approximation, while still retaining 
all the advantages of its analytical simplicity. 

The plan of this paper is as follows. In Section 2 we 
collate the results on linear response approximation. In Sec- 
tion 3 we formulate a discrete version, more suited to real 
data and apply it to construct the free form estimator for 
the equation of state. We then add the regularizing terms 
to modify the estimator to guarantee smoothness. In Sec- 
tion 4 we use a simple model for dark energy to illustrate 
the performance of the regularized estimation and compare 
it to the unregularized one. Our conclusions are presented 
in Section 5. 



2 LINEARIZED LUMINOSITY DISTANCE 

The exact relation between the luminosity distance and the 
equation of state 'w{z) is non-linear, however, it was shown 
in SPB that by considering a given equation of state as small 
departure from a fiducial equation of state we can approxi- 
mately linearize this relation. In this section we collate the 
necessary expressions. In a spatially fiat universe the lumi- 
nosity distance is given by 



1+2 



dx ■ 



-3/2 



(1) 



[g + Q[w,x\]^'^ 

where x = 1 -\- z, g = Q.m/^Q, and the function containing 
the dark energy equation of state is given by 



Q[w, z] — cxp 



dx w[x)/x 



We have set c and Hq equal to unity in these expressions. 



(2) 



We 



DlIw^"^ + 5w, z] ~ Dl['w'^'^,z] + 5Dl 

5Dl = / Kw{z, z')Sw{z')dz' 
Jo 



(3) 



where the kernel Kw{z, z') is given by the functional deriva- 
tive of the luminosity distance with respect to w(z), evalu- 
ated about w^'^{z) 

A-.(../)- ^^'';7,f-| . (4) 

ow(z ) 

Evaluating the functional derivative for Dl given by Eq. 
gives 

r 3x{l + gy/^ r dy Qlw^^y] 
K^{x,x') = ^ 2x' J^>y''/^{g + Q[w*^'^,y]f/^ (5) 

l_ for X < x' 

The accuracy of the linear response approximation was 
shown in SPB to be better than that achieved by the Super- 
Nova Acceleration Probe (SNAP) survey, which is expected 
to observe about 2000 Type la SNe, up to a redshift z ~ 1.7, 
each year (Aldering et al. 2002). By binning the supernovae 
in a redshift interval of ~ 0.02, SNAP is expected to give a 
relative error in the luminosity distance of about ~ 1%. In 
SPB the accuracy of the linear response approximation was 
shown to be better than 1%, implying that it can be used 
conveniently for a SNAP class data. However, there are in- 
deed finite departures from the linear approximation and one 
must be careful in applying it to real data. For the purposes 
of this paper we use this approximation for convenience, 
since it enables us to regularize the free form estimation of 
the equation of state analytically. We shall apply the linear 
response approximation only to those models for which the 
departures from the exact expression are small. The useful- 
ness of the linear approximation, however, can be improved 
by employing an iterative method described below. 



3 FREE FORM RECONSTRUCTION OF W{Z) 

For the purposes of this paper we simulate the luminos- 
ity distance Di, at a large number, A^dat, of uniformly dis- 
tributed redshifts Zi, up to a maximum redshift z = 1.7. 
We assume a Gaussian noise equivalent to 1% relative error 
in the distances with Oi as the variance. As a first approxi- 
mation we fit the simulated data to a constant w model to 
obtain w = wq.U Q.m is known to a good accuracy this will 
give us a first good approximation to the equation of state. 
We then linearize the luminosity distance around W^"^ = Wo- 
The difference between the given noisy estimate of luminos- 
ity distance and the best fit Dl as obtained from w = wo 
model gives us the residuals SDl- 

For modelling purposes we consider a discrete version 
of Eq.Ol 

SDL{zi) ~Sz'^ Kw{zi,Zj)Sw{z'j) . (6) 

To quantify departures from the constant w = wq we con- 
sider the equation of state to be given in A'^bin uniformly 
distributed redshift bins z'f. with values Wk ~ Sw{z'i.), with a 
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Figure 2. A free form reconstruction of w{z) = —1 + 0.2 sin Az 
without added noise. For this reconstruction we have made the 
assumption that the numerical noise grows hnearly with the dis- 
tance. The thick sohd hne shows the input model, the wiggly line 
is the reconstruction without any regularization and the solid line 
shows reconstruction with regularization. Small departures form 
the true equation of state are due to numerical noise and inex- 
actness of the linear response approximation as before. 

redshift spacing 5z. The number and placement of bin posi- 
tions for 5w is such that the the equations generated by the 
maximum likelihood procedure, to be described below, yield 
a unique solution. The value of Sw at the position of the far- 
thest given distance cannot be inferred from the data, since 
it has no effect on any of the distances. In practice we also 
exclude those bins that are close to the farthest redshift for 
reconstruction, since the reconstruction is too noisy in those 
bins. This particular expansion is especially convenient since 
if we have prior knowledge about the range of w{z) then it 
is extremely easy to code that into the reconstruction pro- 
cedure. 

We define the normalized vector d = {SDL(zi)/ai}. 
Similarly we define w = {Sw{Zi)} and IC = 
{SzK{zi, z'j)/ai}, where IC is a. N x M matrix. In terms 
of these quantities a maximum likelihood reconstruction is 
equivalent to the standard procedure of minimizing the Xs 
function 

X^s^id-ICwfid-lCw) (7) 

with respect to w. This can be done analytically to give 

w = {IC^fCr^fC'^d , (8) 

as the required estimator for w. In general Eq |H| gives a 
very noisy estimate for the equation of state. This is due to 
the fact that too many parameters are being estimated so 
the estimator fits most of the noise as well, and this lack of 
resolution is a general feature of the free form fitting (Sivia, 
1996). This formulation gives the Fisher matrix trivially as 

F = K'^K . (9) 

Huterer & Starkman, (2003) diagonalize the Fisher matrix 
and find that only a few eigenvectors are well determined. 
They expand the equation of state in terms of the eigen vec- 
tors of the Fisher matrix to obtain an approximate form for 
the equation of state by truncating the series after the first 
few well determined eigenvectors. They note that truncating 



Redshift z 

Figure 3. Regularized reconstruction of the same model with 
1% Gaussian noise added to the distances. Different curves show 
reconstructed equation of state for different realization of noise. 
As expected, the reconstruction is better at the low redshift and 
has a large scatter at high redshifts. 



the series biases the estimation. They find that the badly de- 
termined eigen vectors are precisely those that peak at high 
redshift, therefore, throwing away those eigenvectors biases 
the equation to state to zero at high redshift. In the next 
section we describe another approach that does not have 
this problem and is better able to represent the equation of 
state at all redshifts. 



3.1 Regularization 

The expansion described above does not guarantee smooth- 
ness or continuity. In fact, for large A^bin the solution fits 
most of the noise as well, and therefore gives a very small 
value of x^- Since an acceptable model would give x^ ~ A'^dat 
we might wish to modify the best fit w to ensure some 
smoothness. As noted above, the amount of information con- 
tained even in a SNAP class experiment is too little to ade- 
quately constrain ■w{z). Additional information in terms of 
continuity and smoothness constraints tend to fuzz infor- 
mation across the bins and reduces the degrees of freedom 
of the free form fitting function. In regions where the data 
is not discriminatory enough, the derived equation of state 
tends to extrapolate from the well constrained regions and 
can provide useful information. As an obvious warning we 
note that in general this is a dangerous thing to do since 
it might bias the estimator, or even create spurious signal. 
In our view these disadvantages are outweighed by the fact 
that such a scheme would gives us, at least, a fighting chance 
to infer the behaviour of 'w{z) in a way that is independent 
of the specific form of w{z) chosen to fit the data. Regu- 
larization also reminds us that we are explicitly assuming 
smoothness for w{z), rather than sneaking it in the form of 
smooth fitting functions. 

To ensure continuity and smoothness we modify the 
above to 

N-l 

1=1 
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Figure 4. Reconstruction for tlie same model and same realiza- 
tions as in Fig 13 but with 10 times less noise. Reconstruction 
works very well at the low redshift. At redshifts z > I the recon- 
struction is slightly biased, consistent with FigQ due to inexact- 
ness of the linear response approximation. 



The added terms ensure that the first and the second deriva- 
tive of w remain small. The weights A and P present the 
problem that in the absence of prior information about the 
first and the second derivatives of w it is difficult to decide 
how to set them in such a way that the solution does not get 
biased significantly. If A is set too large then the preferred 
solution is a constant w, and if (3 is set too large then the 
preferred solution is a linear function of z. If the data is of 
good quality, and a linear or a constant solution are not good 
approximations to the true 'w{z), then the inclusion of these 
terms will drive the solution away from the ideal solution 
and will drive the usual Xs to unrealistic values. Therefore, 
our choice for A and (3 ensures that the value of Xs should 
lie in the range iVdat - \/2iVdat < xl < Nd^t + V2-/V"dat. 

It is convenient to write the above equation in the form 



= Xs + w(jr^jr)w + /3w(5^5)w 



(11) 



where is a (A'^bin — 1) x Nhin matrix and is non-zero for 
- 1 for i = j 

1 for i = j — 1 

and 5 is a (A'bin — 2) x A^'bin matrix and is non-zero for 



(12) 



Sij — 



-1 
2 
-1 



for i — j 
for i — j — 1 
for i — j — 2 



(13) 



In terms of this new regularized x^ the solution Eq |H| : 



modified to 



(14) 



For further details about regularization and some interesting 
remarks about the connection between the previous expres- 
sion and an optimal Weiner filter the reader is referred to 
Chap 18 of Press et al. (1992). 



4 NUMERICAL INVESTIGATIONS 

For our numerical explorations we adopt the following model 
for the dark energy as the input equation of state 
w{z) = Wo + wiln{l + z) , (15) 
since it has the nice property that wq and wi are the present 
day value of w{z) and its first derivative respectively. Since 
this model has finite departures from the equivalent linear 
model it also serves to illustrate how well a regularized es- 
timation gives information about departures from a simpler 
linear model. The function Q[w,z] defined in Eq|5|is calcu- 
lated analytically to obtain 

(3[«;,2] =a;^"«exp[^ln'(l + 2)] (16) 

Since the linear response approximation is an expansion 
about a given flm, we shall assume its value to be exactly 
known. We generate the simulated data in A'dat = 50 bins up 
to a maximum redshift z = 1.7. For reconstruction purposes 
we employ A'bin = 48 bins for placing the binned w{z). As 
remarked earlier, we do not reconstruct w{z) above a red- 
shift of z ~ 1.6 due to poor resolution. 

The unregularized estimator given in Eq|H] picks up im- 
merical noise even when the distances are exactly given. To 
show how unstable such an estimation is we contrast it with 
the regularized estimation in FigQ which shows the recon- 
structed equation of state for wo = — 1 and wi = 0.2 model 
without added noise (but with small numerical noise due 
to inexact mathematical operations) . The un- regularized re- 
construction follows the true model quite closely but picks 
up numerical noise and appears noisy. The regularized re- 
construction, on the other hand, follows the true equation 
of state quite closely. The tiny departures from it are due 
to the fact that the linear response approximation is not 
exact. This clearly shows that a reconstruction without reg- 
ularization is ineffective even when the statistical noise is 
absent. 

Since the unregularized estimator is extremely sensi- 
tive to noise, we can improve its performance by taking 
into account the inevitable numerical noise due to inexact 
mathematical operations to make the comparison fair. To 
a good approximation the numerical noise grows linearly 
with the distance. If we normalize d = {6DL{zi) /ai} and 
JC — {5zK{zi,z'j)/ai} with at oc Di{zi) then we find that 
the unregularized estimation is stabilized to some extent. 
To illustrate this effect, and to show how the reconstruc- 
tion works for a model that shows strong departures from 
a straight line we also reconstruct the equation of state 
w{z) = —1.0 -1- 0.2 sin Az in Fig |21 without added statisti- 
cal noise. We find that the reconstruction works better than 
before for the unregularized case, but the regularized esti- 
mation works better in both the cases. 

To quantify how the regularized estimator works for 
noisy data we add a 1% Gaussian noise to the previous 
model ((Ji = .01 x DL{zi)). We fixed the weights A and (3 
to ensure a reasonable Xs for this experiment. Fig |3 shows 
the outcome for 10 realizations of the noisy data. The recon- 
structed equation of state typically has a scatter of about 
~ 0.2 at low redshift. At large redshifts the reconstruction 
is poor but remain unbiased. To see the effect of decreasing 
noise we lower it by ten times for Fig The reconstruc- 
tion now works much better, as expected. The scatter at 
the large redshift is still substantial, however, the equation 



A regularized free form estimator for dark energy 5 



of state is reconstructed very well up to 2; ~ 0.7. We also 
find that the reconstruction recovers the shape of'w{z), even 
up to large redshifts in many cases. In part this success is 
due to the fact that regularization extrapolates from the well 
determined low redshift w{z). 



4.1 Noise Estimation 

Quantifying errors on the reconstructed equation of state is 
not simple in this approach. One way to do this is to use 
the reconstructed equation of state to calculate the Fisher 
matrix in Eq|^ The inverse of that would yield the required 
covariance matrix. This would be equivalent to assuming a 
Gaussian distribution for the estimator in Eg 1141 Our nu- 
merical experiments show that the distribution of equation 
of states generated for different realizations of noise by the 
regularized estimator is not close to Gaussian. In fact, as 
Fig 13 shows, the curves fill the space in a very complex 
fashion so the distribution of w values at any given redshift 
are not well approximated by the Gaussian distribution. To 
take into account this effect we generate 1000 realizations of 
data and plot the envelope of all the curves obtained from 
different realizations. The scatter is, of course, more concen- 
trated around the true equation of state. The result is shown 
in Fig 121 where for comparison we have plotted the same for 
the case where /3 is kept equal to zero. The figure shows that 
the when /3 7^ the noise goes down in the estimation at all 
redshifts. This is what we would expect since this term adds 
information about the second derivative in the estimation. 

The envelope for P — shows a weak sweet spot at 
2 ~ 0.1 while the one with a non-zero /3 the sweet spot be- 
comes stronger and moves to z ~ 0.2. In fact, if we consider 
the Fisher matrix of the unregularized estimation in Eq|3 
we find that no sweet spot appears anywhere. This is in- 
deed as it should be since the w values at small redshifts 
affect the distances at all the higher redshifts, so should be 
better constrained. If we increase P the sweet spot moves 
to z ~ 0.3 and becomes stronger. This behaviour suggests 
that the sweet spot is, in general, an artifact of the partic- 
ular method employed in the estimation. The demand that 
the w{z) have a small second derivative cannot fit the data 
at all redshifts adequately, so it develops an anchor at an 
intermediate redshift, as is seen in Fig|5] Huterer & Stark- 
man (2003) express similar views on the origin of the sweet 
spot in their paper. 
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Figure 5. Here we quantify the scatter in the regularized estima- 
tor by plotting the envelope enclosing 1000 realizations of noisy 
data. The dot-dashed curve has A set to a fixed value to give 
~ A^dat and /3 = 0. The dashed curve has both A and /3 set to 
fixed values. Imposing two regularizing conditions decreases the 
scatter and improves the performance at low redshift. 



of the properties of dark energy is the present day density 
in the form of pressureless dark matter. The results in this 
paper assume this density to be known but can be easily 
generalized to take this into account properly. Due to its 
analytical simplicity and due to the fact that by construc- 
tion it is unbiased, the regularized free from estimation is 
superior to all others. However, we do find that artifacts of 
regularization appear in the form of sweet spots. It is fair to 
say that at the level of accuracy that a SNAP class experi- 
ment will achieve it seems unlikely that this method will give 
any more information than that given by simple polynomial 
fits to the equation of state. Since this method is well suited 
for combining supernovae data with other cosmological tests 
it might yet prove to be a more useful way of constraining 
the properties of dark energy. 
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5 CONCLUSIONS 

We have shown that the limitations of the free form esti- 
mation of dark energy can be overcome by simple regular- 
ization, which substantially improves its performance. Our 
regularizing terms incorporate smoothness of the equation 
of state and its first derivative, but can be easily generalized 
to take into account further information about the equation 
of state. We have explicitly constructed an analytic form 
for the regularized estimator for the equation of state by 
employing the recently introduced linear response approxi- 
mation which allows the maximum likelihood estimation to 
be performed analytically. Although the linear response ap- 
proximation is not perfect, its applicability can be extended 
by iteration. The major uncertainty in the determination 
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